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ABSTRACT 

This paper explains the use of intrinsic analysis 
procedures developed, as part cf the Pennsylvania School Improvement 
Program ^PSIP^, to evaluate and choose curriculum materials and 
instructional programs. An intrinsic analysis, as distinct from an 
evaluation using outcome measures or classroom processes, employs 
research criteria to make decisions about the adequacy of curricular 
coBponents. The intrinsic analyses looks at four elements of the 
Cooley-Lohnes Model for assessment of classroom, practices: 
motivators, opportunity, structure, and instructional events. It also 
draws upon the Process Indivi dual5.«ed Curriculum (PIC) model of 
curriculum design- When usinc this analysis of curriculum materials, 
the investigator first assesses whether the materials provide the 
conditions that research suggests are motivating to students* Second 
is an evaluation of the in-'-ensity of the cognitive activity provided. 
Analyzing structure involves examining structure, sequence, placement 
procedures, testing >idequacy, and exemplary appropriateness. Finally, 
instructional strategies are analvzed for appropriateness, 
consistency, provision for higher level skills, and adequacy of 
teacher manuals. (Author/JM) 
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^ I. INTRODUCTION 

The Pennsylvania School Improvement Program (PSIP) is working 
with schools to help them improve instruction in basic skills. Funded by 
the National Institute of Education, this program.is one of seven projects 
designed tp help schools identify their needs and select and install solu- 
tions to meet those needs, employing the knowledge, programs, and 
practices generated by the research and development community. This 
paper describes curriculum analysis* one of .the procedures which will 
be used whenever it seems appropriate in the selection process. • 

The PSIP has established a network of agencies to work with 
schools in improving instruction. All of these agencies have long been 
engaged in educational administration, research, design, development, 
.and implementation. Now they are linked in a concerted effort to improve 
Pennsylvania schools. Two of the agencies are research and development 

agencies: Research for Better Schools, an educational laboratory, and 
the Learning Research and Development Cente^r, a university- based R&D 
Center, One agency is a dissemina^on agency: Research and Information 
Services for Education (RISE). The other two fire state and regional edu- 
cation agencies: The Pennsylvania Department of Education and Intermedi- 
ate Units, The PSIP currently is working with two Intermediate Units: 
Northwest Tri-County Intermediate Unit #5 and Colonial Northampton 
Intermediate Unit #20. 

Most of the tasks involved in the identification of needs and of po- 
tential programs and practices to meet tnose needs use procedures which 
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are not uncommon in the education field. While the specific tasks under- 
taken by^the local action team, in the PSIP needs and program analyses 
and solution^ screening and selection processes, may vary slightly from 
School to school and include novel activities and procedures designed by 
PSIP staff, they a^ essentially procedures approved and frequei^tly em- 
ployed by uniy^^ity/ school consultants and by research agencies working" 
with schools.! 

These. specific elements and innovative features of the PSIP proc- 
ess are being carefully nnonitored and reported for formative evaluation 
purposes, and to maintain a record of effective and ineffective procedures 
for improving schools through utilization of the knowledge and products 
developed by educational research and development. 

One projected activity of the PSIP, that is not a cuptomary proce- 
dure used by research agencies or university /school consultants, is the 
intrinsic analysis of the programs or practices which remain as viable 
candidates after the "'field of potentially effective research and development 
outcomes has been narrowed to a few which meet the local action team's 
criteria and constraints. This projected analysis will be useful only un- 
tJer certain conditions and its use will, necessarily, vary considerably 
according to the nature and scope of the outcome considered. It may be 
used, also, to examine closely the present program, if it is to be retained 
in part or retained in its entirety with supplemental new elements. ^ 

The rationale for use of intrinsic curriculum analysis procedures, 
the description of tho'se procedures, specification of the knowledge and 
skills necessary to carry out art intrinsic analysis, and identification of 



ERIC 



the Information we can expect to attain if we use th^se procedures are 
the substance of this paper. 



11. RATIONALE FOR CURRICULUM ANALYSIS 

Selection of Curriculum Materials 

When schools select curriculum materials they do it by a variety 

'of methods, some formal, some very informal. We know of frijany cases 

- \ 

,whcn the charisma of the salesman, the attractiveness of the lextbVok il-- 
lustrations, or the persuasiveness of the advertisements in professional 
journals have tipped the balance for a particular choice. Most sel-ections\ 
however, are made by committees following specific guidelines. 

A report of Educational Research Service (ERS) analyzes ^election 
procedures used in 414 selected school districts from 33 states and the 
District of Columbia (Kunder, 1976), The 17 states not included choose 
textbooks and instructional materials at the' sfate level and therefore local 
districts have very limited choice. Of the districts re^onding to question- 
naires, 72, 7 percent have some kind of written textbook and materials se- 
lection policy, 27. 1 percent do not (one school did not respond). For sup- 
plem©<itary materials, only 50. 7 percent have written policies, 49. 3 per- 
cent do not. All states are governed to a greater or lesser extent by legis- 
lative requirements regarding curriculum materials selection. 

One of the major problems for which curriculum materials policies 
are devised is not to determine the instructional quality of the materials 
but to ascertain that nothing offensive to any group of citizens is to be found 
in the materials. Recent challenges to textbooks and instructional materi- 
als were made in 26. 3 percent of the 414 responding districts, 21. 5 percent 
to supplementary materials. No challenges were reported by 6.9.8 percent 
and 65. 5 reported no challenge to supplementary materials. 



The £RS report identifies some of the issues confronting school 
districts in the selection of textbooks and instructional materials. Two 
of these are appropriate minority representation and avoidance of sex 
stereotyping. Often there are challenges to selections on the basis of re-> 
ligion, ethical, political and moral grounds. Of the schocl districts sur- 
veyed in this report, 66.2 percejnt |iave policies to deal with such chal- 
lenges, 3, 1 percent did not respond to this item and 30. 7 percent do not 
have a policy. ^ 

Of the 414 responding school district^ 61. 1 percent have general 
statements of criteria for selecting textbooks and instructional materials, 
2. 4 percent did not respond and 36. 5 percent have no written sfst^ment of 
criteria. 

Most of the elaborate selection procedures include meetings, some- 
times called ''hearings** with publishers' representatives (Kunder, 1976) and 
publishers often furnish the in-service training for implementation. These 
publishers' meetings are a protection against favoritism and possible dis- 
honest dealings, but they provide an opportunity for th^ publisher to explain 
the product to the consumer and to respond to questions. Publishers' eval- 
uation and descriptions of their own products, however, cannot be disinter- 
ested. 

Criteria established by school districts usually are related to the 
^district's goals, including integration, student self-image, appreciation of 
human accomplishments, acceptance of human similarities and differences, 
sensitivity to stereotypes, prejudice, bias, etc. Other characteristic cri- 
teria are accuracy, appeal, good organization, physical attractiveness and 
durability, match to school objectives, and appropriate articulation. 



In summary* while a majority of school districts have, writtetn selec- 
tion policies and established criteria, about 27 percent of the districts have 
no written materials serection policy for textbooks and 49 percent have no 
policy for supplementary materials among 414 school districts in 33 statela* 
More than 26 percent h^ve nb#.establiShed criteria, and even those with elab- 
orate and quite specific procedures and criteria appear to rely quite Keayiiy 
upon publishers' representatives for information about the materials and 
often for the teachers^ in-service training for implementation* 

Two states, Florida , and California, include in their selection laws 
learner verification and revision clauses which put the responsibility upon 
the publishers for gathering data on their products and using them for im* 
provement (Kunder, 1976, p. 17)# This makes it necessary for publishers 
to base revision on results obtained in the classroom gather than merely on 
obsolescence of information^ fads or attempts to increase sales. 

Of course, research and development agencies typically employ pilot 
and field testing and use the information gathered for formative evaluation 
of the materials* Yet, like publishers, R&D agency developers are hardly 
disinterested evaluators of their own products when they do their own sum- 
mative evaluations, and neither publisher nor R&D agency developer can pro 
vide as useful an analysis di a product or process as <:an the ultimate con- 
sumer whose needs and goals are unique* 

Product presentation by developers and sal^s descriptions of pub- 
lishers usually provide information about the theoretical basis for the prod- 
uct. The NIE product catalogue lists the subject area, goals or purposes, 
patterns of use, assessment provisions, time requirements, implementation 



procedures; aOmmary cost information, persohnel required for adoption 
^and implementation^ . and assurances and claims. Materials and equip- 
ment included also are listed (Catalogue of Nl£) Education Products, 1975). 
Mostly, however, information available to consumers emphasizes 

descriptions of products, indicating the presence or absence of various 

» 

curricular plement^v such as behavioral objectives, and claims about out-, 
comes or results o/>^usfihg the products, rather than Specific infa.rmation / 
about their quality , • ^ , * • 

^ * Procedures for selection specified by sqhool districts usually in- "\ 

" ' • ^ . • ./ > ' . 

elude exjimination 6f materials to identify presence or absence of elements 

identified as necessary and of value to that districts Usually, some of the 
questions raised'in the selection criteria listings for .consideration in re- 
viewing materi)als require a judgmer^t of quality on the part of tjie reviewer^ 
However, none this writer has ever seen has specified a standard against 
which to make the^judgment* That means, of course, that the quality of - 
the review depends upon the Specification of qualifications for membership 
on the selection comn^^ittee and the care with which appointments are made 
to such a committee* Members of such committees include school board 
members, students, parents and civic leaders, who probably could respond 
to questions related to content, appeal, qviality, or durability, and who pro- 
bably should be involved in considering'^questions of match to goals, appro- 
priateness to student population, bias, and other general questions* AI90 
included are school administrators, teachers and staff specialists who 
might be better qualified to respond to questions of technical quality* Pre- 



sumably, the non professional members of selection committees could de- 
fer to professional members on such questions of technical quality. 



Thl8> paper suggests that selection proce&ses should be more care- 
fully tailored to the specific needs of individual schools and that part of 
the process of identifying appropriate products or processes should be 
procedures for intrinsic analyses of curricular materials and instructional 
processes using as criteria the identified needs of a school, and as stan- 
dards of quality the research-based principles of instructional design and' 
what the research says about each element to be evaluated. . , 

An intrinsic analysis is an analysis of the curricular materials them- 
selves. However, it is not limited only to materials used by students. The 
intrinsic analysis process may be used on teacher manuals, tests, and in- 
service training materials. It is not limited to instructional products but 
may be used, also, on management systems and other processes. What is 
required is^naterials, which I call the artifacts of the instructional system^ 
so that they may be analyzed. They may be direct instruction in the form 
of readings, workbook exercises, tapes, filmstrips, or recordings. They 
may be directions to the teacher relating to her teaching behavior, to back- 
ground information, to her management behavior, etc. They may be student 
or class record forms or tests. They may be scope and sequence charts* * 
Any tangible evidence of the instructional program provides the input for 
an intrinsic analyses of that program. 

The process of intrinsic analysis, which this paper proposes, employs 
procedures which can be taught to selection committees, analysis instruments 
to collect the information about the product or process and a decision*oriented 
comparative matrix for final selection. Before these are described, however, 
in the next section we examine the existing analysis instruments, which are 
used for much of the curriculum analysis that is currently available to school 
decision<»makers« 

10 
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Existing "Analysis Ipatruments 

Of the analysis instruments I have reviewed, the three most useful 
are those of Tyler and Klein (1971), Eash (1974), and that of Morrissett, 
Stevens and Woodley (1969)« The first of these actually is a list of ele- 
ments which are recommended as essential, very desirable, or desirable 
for selection of curricular materials. These are grouped in seven cate- 
gories: rationale, specifications, appropriateness, effectiveness, condi- 
tions, practicality, and dissemination. The recommendations are addressed 
both to decision-makers and curriculum developers, since most of the es- 
sential elements would have to be-supplied by the developer (e. g, , the 
bases for the selection of the content of the curriculum and instructional 
materials). However, the recommendations are intended to help consum- 
ers in selecting materials and the authors suggest they would be useful^ 
also, for evaluation of curriculum and instructional projects by funding 
agencies. 

The Morrissett, Stevens, and Woodley instrument (1969) is called 
the Curriculum Materials Analysis System (CMAS) and has been revised 
several times. It \yas developed at the Social Science Educjation Consor- 
tium and has been used by teachers in making over ZOO analyses since 
1967. A publication of the Consortium, A Social Studies Curriculum Ma - 
terials Data Book, has been published with more than 72 analyses of so- 
cial studies curriculum packages. This system has major categories of 
questions of a general nature with subordinate questions which elaborate 
on those at tl;^e first level. Most questions require a scaled response such 
as very low, average, high, on a scale of 6, or NA (not applicable), UA 
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(unavailable), and finally, there are spaces for indicating both decree of 
certainty of the response (C) ahd that the narrative statement about the 
materials should be read, see narrative (SN) (CMAS, 1971). 

CMAS interjects the analyst into the process in a hirghly personal 
way. For example, one question is, ''Do you agree with the rationale?'' 
The document clearly is for teacher, use and is addressed largely tu 
teacher judgment of materials with minimal direction for how to make 
that judgment* The direction consists mostly of definitions of terms and 
single paragraph explanations of theory. It depends heavily on the exper- 
ience and knowledge of the analyst-teacher, but it does not prescribe any 
specific required skills or preparation for the analysis task. 

Ian Westbury, in an article on curriculum evaluation, dismisses 
CMAS and Tyler and Klein as instruments which '*do little more than point 
out the most obvious questions that couljl be asked of a curricular docu- 
ment. They do not lead a critic into the structure of a program as such 
structure bears on more complex questions of evaluation'* (195K), p. 251). 

He thinks Eash's model is a little better because it does include 
questions about task analysis (1970, p* 252). ''Has a task analysis been 
made of the material and some relationship specified between the tasks? 
If a task analysis was made, what basis was used to organize the materi- 
als?^^ (Eash, 1974, p. 129)* 

However, the Eash model is subject to the same criticism as CMAS, 
it does not indicate either skills necessary to perform the analysis nor 
does it inform the analyst how to uncover the information it asks for, if 
it has not been provided by the developer. It provides definitions as does 
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CMAS, but some of its questions are totally inappropriate. 'For^ example, 
the question. on sequence asks the critic to check as many as appropriate 
and then lists supposed bases for sequence. Those listed are a hodge- 
podge bf items, some related to structure of a discipline and some to in- 
structional strategies. How one would use the responses to evaluate is 
difficult to discover. Probably each critic's judgment criteria would be 
different. ^ 

The Educational Products Information Exchange usually lists and 
discribes the instructional approach, available components (such a% w^ork- 
books, teacher manuals, etc.), objectives and scope, sequence, methodoU 
ogyf evaluation and regord-keeping, and then provides a summative_fe.y5ilu- 
ation comment. Such sumrjiative evaluative comments often a're found in 
analyse^«. /Most of the items in the instruments require that th0 analyst 
check off presence of or absence of elements and some require an evalua- 
tion of the elements on a rating scale. Eagh also describes the typical 
characteristics of an element tha^ should be rated low, average, or high. 
However, the bases are not given for judgment that objectives are vague, 
sequence is illogical or not detailed enough or that it is theoretically sound 
or unsound. All of these are among reasons for specifying, a particular 
rating, but reliance is upon the critical judgment of the analyst. When the 

basis for that judgment is not supplied or even hinted at, the criteria used 

I 

by the analyst for determination of a theoretically unsound curricular ele- 
ment, for instance, ^ could itself be unsound. 

^n short most instruments currently used for analyses of instruc- 
tional materials are primarily descriptive or are evaluative without estab- 
lishing criteria for evaluation and therefore are useful only for initial 
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ecreening to eliminate those products which clearly do not meet the needs 

a 

of the individual school. To identify those which meet quality standards 
and which may meet identified student needs, instrurnejits are needed for 
in-depth intrinsic analysis of the rnaterials. In addition, there must be 
both criteria for responding to the questions the instruments and pro- 
cedures for carrying out the analy sis. These procedures and practice in' 
carrying them out and in applying the criteria to materials can be the sub- 
stance of in-service workshops for teachers and administrators. 

Two recommendations made by the Educational Products Informa- 
tion Exchange are (1) that training should be provided for members of text- 
bopk and instructional materials selection committees and -(2) that adequate 
time and resources should be allocated for the task (EPIE, 197 3). Both of 
these are of tremendous importance in the selection of any new instructional 
system. They become significantly more important when, as is usually the 
case,^ parts of a system are sought for adoption, fpr example, when svxpplemen 

inagement system, or textbooks 
.s the basal text that is be'ing 

1, « 

replaced, if that is happening. in a single grade, and if the other materials 
at that grade level,' in that subject area, remain the same, training of the 
selection committee and adequate time and resources to make the selection 
are vital to the success of the adoption. This will be discussed more fully 
in the foUov/ing sections. 

How>Analys is Can Faci litale Sc hool Decision^Making 

While it is clear to anyone who has worked in or with schocrls or has 
read the research that teachers make a difference and that materials alone 
cannot have an appreciable effect on student achievement, it is obvious that 



tary materials are considered/ or a new man 
for one level in a classroom. Even when it ii 



schtDols, which spend a substi^tial amount of their budget on jnsrtructional 
materials, want to attain the most, effective materials available for their 
stiklents. Th^ selection of high quality materials that haye been proven.. 
■ effective has been considerably eased by catalogues .of products of educa- 
tional research and development centers and laboratories (Cfirtalogue of 
NIE Education Products, 1975) and of exemplary programs developed by 
local school districts and validated the Joint Dissemination Review ^ 
Panel of the Department of Health Education and Welfare (Educational Pro- 
grams That Work, 1976),* Such catalogues provide an excellent first look 
at potential fnaterials to meet school needs. If local schools are selecting 
new program^ or practices without the help of selection facilitators such 
as the Pennsylvania School Improvement Program teams, these catalogues 
may be examined as a first step in the selection process after identification 
of^their needs and constraints and establishment of the criteria they want 
to use in screening possible products. 

Sometimes a program or practice appears to be exactly what the 
school is looking for. This can happen only when a local selection commit- 
tee has a pretty clear idea of what it needs and wants, of course. In such 
a case it is oftefi possible to have representatives of the publisher, or the 
developer prpvide more information and even in-service training in the 
use of the materials. Often, it^is possible to visit schools using the materi- 
als to judge at first hand how they look in operation. 

However, in many cases schools have problems that are not -so read- 
ily solved. Often schools want supplementary materials to meet needs of 
special groups of students, gifted children or underachievers . Often schools 
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want to keep their basal texts but need to manage the classroom differently 
in order to meet individual student needs. They may want to adopt a new 
management system. ^ 

Even when a school, is- atlopting a totally new progsam with the help 
of packaged or personalized publisher-supplied in-s.ervice training there is 
a need for a thorough analysis of the present program and the new program 

; • because parts of the present program still may be used and the adopted pro- 

<, • 

gram certainly will be adapted to the needs of the adopting^ school. How to • 
adapt requires substan^al, in-depth knowledge of the materials, old and 
new, which will be combined to meet the school's requirements. 

If the school does not find the suitable program or practice immedi- 
ately, the identification of several possiblesr makes an analysis to facilitate 
decision-making particularly essential. ^ - ; 

The steps in the process are; 

1 • needs analysis 

2. prese.nt pf ogram analySi-s 

3. iderftification of constraints and criteria 

4. problem solution screening process 

5. identification of possible products br processes 

6. intrinsic analysis of possibles 

7. summary presentation of th^se potential adoptions 

8. selection ^ 

9« ins talliation/ adaptation 

10. implementation ' , . 

You will note that an intrinsic analysis takes place at step 6. It may 
take place, also, at step 2. Whether or not an 'intrinsic analysis is per- 
formed on the present program depends on several considerations. It may 
be necessary because the needs analysis has identified problems which may 
or may not be attributed, in part, to materials. Unless the deficiency in 
the materials, if any, is identified, it would be wasteful of tirne, effort. 



and money to search for new rhaterials. On the other hand, if the teachers 
alneady havtf identified weaknessiss in the materials and are seeking prod- 
ucts that are superior along the dimensions identified as v/eak in their 
.present program, no analysis- may be required at this stage. 

Another reason for an intrinsic analysis at stage 2 would be if the 
local selection committee (local action team in the PSIP process)/ during 
the needs analysis stage, should have (decided that an inventory of available 
miscellanepus materials must be taken and they must be systematically 
coded to the program's objectives in order to provide a structure for in- 
dividualization* After this procedure was completed, there would be es-- 
sentially, a new program created which Vl^ould require analysis in order 
to supply sufficient information oi^product or process needs to facilitate 
the succeeding stages of the process. 

Stages 6 and 7 may be lengthy and time-consuming or tljey may be 

quite simple and brief depending on the preceding stages. If constraints 

and criteria are many, the number of identified products or processes may 

be very few and the .screening process short with only one or two potential 

problem* solutions identified. On the other hand, if constraints and criteria 

.> * * 
are few and/ar if several needs have been identified, there may be many 

alternatives which the selection committee wants to consider. 

Of course the analysis of curriculum products aAd of processes, such 
as management systems, use different information gathering instruments 
(see instruments in appendix)* Both analyses are presented to the selection 
committee in the same format, a single decision-oriented matrix which in- 
cludes ratings for each potential adoption along several important dimensions 
which will be discussed' in Chapter II. ^ 
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III. DESCRIPTION OF THE INTRINSIC ANALYSIS PROCEDURES 

Elements of the Intrinsic Analysis Model 

The Learning Research and Development Center has pioneered 
in the use of a model for-evaluation, the Cooley-Lohnes Model (Cooley 
& Lohnea, 1977; Cooley & Leinhardt, 1975). Thi^ model employs six 
constructs for the investigation of classroom processes: initial student 
performance and ci^iterion performance, opportunity, motivators, struc- 
ture and instructional events. The constructs, have been used by the 
PSIP for collection and organization of data on preseht practices. In 
addition, information is collected on student, teacher, and community 
characteristics, broader constructs than initial and criterion student 
performance, because of the diagnostic rather than evaluation purpose 
of PSIP's data collection. Rationale for use of the Cooley-Lohnes con- 
structs for this n,ew purpose was based primarily on the opportunity to 
provide for. building data on scfiool change from a variety of R&D Utili- 
zation Project sites in consistent categories of educational processes 
that seem to be important to learning (Cow, 1976). 

For materials analysis purposes, four of the constructs are used: 
opportunity, motivators, .structure, and instructional events. The im.- 
portance of the elements sampled by these const-ructs is well supported 
by research (Wiley & Harnischfeger, 1974; Rosenshine, . 1 971 , 1976; Stall- 
ings &( Kaskowitz, 1974; Walker & Schaffarzick, 1974; Cooley & Leinhardt, 
1975; Brophy and Evertson, 1 974;^ Ami?Jori and Giammatteo, 1967; Lewin, 
Lippitt, &c White, 193^^ Goodman & Goodman, .in press; Smith, in press; 
Berliner & Gage, 1976; Soar, 1973). 

\ 

I 9 

; 
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The use oT the constructs for intrinsic analysis, as for data col- 
l,ection on present school program and practices^ both suggests elements, 
which ahould be examined because they have been found to be significant 
factors in achievement, and provides an organizational fran.swork for 
collection of the informajtion. 

The purpose of intrinsic analysis also draws upon an existing iDod- 
el, the Proces's Individualized Curriculum (PIC) model of curriculum de- 
sign (Gow, 1977b), Just as the Coqley- Lohnes evaluation constructs have 
been put to two new uses', different from the evaluation purpose for which^ 
they were designed (diagnosis and analysis), so the PIC model is used as 
the conceptual and procedural basis for th^ intrinsic analysis of present 
program and potential R&D outcomes for adoption. Since the curriculum 
design model is based on^ research results also, it follows that the under- 
lying design principles can be used to guide the analysis of existing curric- 
ula. The principles, then become the criteria for the Analysis. The pro- 
cedures for building a curriculum and the procedures for taking one apart 
rest on these same '^priufClples of effective instruction.- 

The intrinsic analy-sis model may be employed in a comprehensive 
study of proportions that would be best undertaken by an R&D agency'or in 
a simplified, sampling and spot checking process that could be used by 
teachers in in-service workshops. In tljp former case, the entire hierar- 
chy of expressed or implied, behavioral objective^, which is essentially a 
blueprint of the course, is reconstructed. In the latter case, the hierarchy 
construction process is used only as a tool to sample the adequacy of struc- 
ture. In both comprehensive and simplified atlalyses, the essential elements 
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of the design model of the curriculum being analyzed are identified. The 
relationship between design and analysis has been shown by the following 
diagram (Cow, 1977a). 

I 

Desicn- Instructional ^ Goals T4i«ra ^Instructional 

Model — >(Objectives)->"^^^*^^^*^^— > Materials 



Analysis: Instructional^^ Goals Hierarchies —^^"^^^^^^^^^"^^^ 

' Materials ^(Objectives ^ Model 



Objectives and hierarchy may or may not have been specifjed in the original 
design of the curriculum. Whether they were specified or they were not, 
objectives and some structural organization exist in any fdrmal instructional 
situation and these are part of what the analysis process seeks to uncover. 

The intrinsic analysis of instructional products and processes used, 
when appropriate^ for both program and R&D outcome analysis by the re- 
search team and school assistance team of the PSIP employs bpth the 
Cooley-Lohhes constructs and the PIC design/analysis model. A descrip- 
tion of the procedures for products and processes follows. 

Products 

The R&tD Utilization Project, under which the Pennsylvania School 
Improvement Program is funded, calls the materials produced by research 
and development R&D outcomes. These outcomes include both products 
and processes. Many of the outcomes are described in the catalogues re- 
ferred to previously. Some of the processes, such as the new more care- 

fully tailored-to-site procedures that are being designed by this project. 
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including the model for intrinsic analysis described in this paper, do 
not yet have completed tangible materials (artifacts) to be analyzed^^ 
They are being designed and tested as part, of the project's task^ Other 
processes, that may be adopted and adapted by the schools we are work* 
ing withy have been used ^nd validated elsewhere, include tangible ma- 
terials describing and facilit^ating use of the process, and may be analyzed 
as described in the section on processes^ 

To analyze instructional products^ materials which should be ex- 
amined, include as many components as are in use or. being considered 
for adoption and, at the minimum, lists of other available elements of the 

system^ Preferably, samples of each element that is considered part of 

the instructional system, but is not to i>e purchased, should be obtained 

for examination^ Products would include the following; 

1« Instructional materials for students: texts, work- 
books, tapes, filmstrips, supplementary readers, 
games, etc. ^ 

2, Teacher manuals for use with the instructional ma- 
terials, record forms .and other rhanagement sys- 
tem forms, tests, answer keys, planning booklets, 
etc, 

3. In-service training materials to be used With the 
above instructional materials and management sys- 
tem* 

Fqr a curriculum that does not have explicitly stated objectives, 
the student materials are the main source of information about what con- 
tent, concepts, and skills the curriculum is seeking to teach. To supple- 
ment the examination of the student materials, the teacher manuals or 
guides should be examined. These usually are quite explicit about the 
content, concepts and skills the curriculum seeks to teach, even when 
specific objectives are not stated. 
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Some rich curricula probably teach more than they test for or ex- 
- press as objectives. Consequently, if a skill is taught in the instructional 
materials and practiced in the student exercises, it may be assumed that 
skill is an objective of the curriculum, whether or not there is an ex- 
pressed objective for it. Similarly, if a concept is introduced with multi- 
ple examples, it may be assumed that the concept is an objective. On 
the other hand, content, facts, and isolated examples of concepts may 
well not be objectives to be -learned if they are not listed as such. 

Important sources of input data for the analysis in addition to the 
artifacts listed above are the rationales and prpfes.sional journal articles 
describing the curriculum by the developers and advertising materials 
written about the curriculum. These sources usually describe the educa- 
tional philosophy of the developers ^nd the specific goals of the curriculum. 

The first step in performing an intriijsic analysis on a curriculum 
product is to gather the materials identified above and to scan them, as 
one would skim an article or examine a book, looking at format and gen- 
eral content. This inyentory-taking process provides an initial sense of 
the nature of the total program. 

The next step is to examine the student And teacher materials for 
dimensions which fall under each of the four constructs. Opportunity and 
motivators are attended first since the process is considerably less com- 
plex than that for analyzing structure and requires less background informa- 
tion than for .analyzing instructional events. . The process of analyzing for 
opportunity and motivators, if it is performed before the more demanding 
analyses, familiarizes the analyst with the materials and makes it possible 



for him or her to select sample portions of the whole sequence for in- " 
depth structure and instructional events analysis, ^ 

Motivators are intrinsic in the materials or prescribed in ^he 
instructor's manual for the teaoher to provide, In tne latter case, note 
is made of motivators which appear to be crucial;to the effectiveness of 
the materials and they are to be id.entified as elements of the curriculum 
model on the Curriculum Model Analysis Instrument, (See appendix for 
analysis instruments, ) This must be noted because if the motivating ele- 
ment is to be provided by the teacher rather than the materials themselves, 
there is no way to be sure the directions are followed. If they are an es- 
sential part of the model, this must be duly recorded. Indeed, for each of 
the constructs, those curriculum elements which appear to be critical to 
effectiveness should be recorded when they are encountered, even though, 
when the analysis is completed they will be reviewed from the informed 
perspective of the analyst at the conclusion of the analysis process. 

Many motivators in curriculum materials are obvious on superficial 
examination and are listed in descriptive analysis instrurpents. Of course, 
there is no need to duplicate these in the process of performing an intrinsic 
analysis. Just as cost and effectiveness information are considered part 
of screening rather than intrinsic analysis, also attractiveness and other 
motivational qualities which can be readily observed during initial screen- 
ing are not attended in the intrinsic analysis process. The analysis instru- 
ments for curriculum products may be used for parent and teacher training 
materials as well as student materials. 
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The materials are examined to determine whether or not condi- 
tions are provided which research suggests are motivating to students. 
Thyre are three major questions around which information is collected: 

1. Is there an .opportunity provided foir the student 
(parent, teacher) to plan his/her own instruction? 

Z. Do materials provide experiences that clearly are 
functional (i^ e. , related to life-experiences)? 

3. Do materials provide reinforcenrtent or do they 
instruct the teacher how and when to do so? 

4. ^ To what extent do the materials make*provision.for 
^individual differences in learning style, interests, 

pate? 

Most of these questions and the more explicit questions subsumed 
under them can be answered readily by any education professional without 
specific further directions. However, in-service training suggestions, 
described in Chapter III would provide experience in carrying out this analy- 
-sis,. The more explicit questions, especially, are not difficult to answer, 
with the possible exception of a question on reihforcement which uses the 
term, Premack principle. However, this is described, with two examples, 
in a footnote to the instrument. 

Opportunity is related to the density or intensity of instfuction. 
Clearly, the materials themselves cannot reveal the amount of time spent 
on them. However, the intensity of the cognitive activity which they pro- 

i 

vide, and which the research suggests is related to achievement (Compensa- 
tory Programs Report, 1974), can be identified. 

Questions asked under the opportunity construct relate to the con- 
centration and appropriateness of the instruction. These, too, are idertti- 
fiable by teachers or curriculum specialists without further jjistruction, al- 
though in-service training for analysis Should include review of learning 
theory relevant to the teacher's own student population. 
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The questions raised in the analysis instrxShient under opportunity 

i 

fall under two major questions: 

1« Do the materials teach in a clear, focused and 
concentrated way, and 
. 2. . Are the experiences appropriate for the student 
population so there is opportunity to Xcarn? 

Probably the most difficult constructs to investigate in the process 
of pexforming an intrinsic analysis are structure and instructional events. 
Analyzing structure involves examining not only structure and sequence, 
but also, placement procedures, testing adequacy and exemplar appro- 
priateness, instructional events, in the context of an intrinsic analysis, 
afe activities prescribed in the materials to be performed by the student 
or instruction to be carried out by the teacher. 

It is in analyzing for structure that the hierarchy construction 
tool of the PIC design/analysis model is most useful. Here, careful 
sampling is of utmost importance. Depending on the purpose of the 
analysis, /use of this tool may be extensive, involving a virtual restruc- 
turing of the curriculum scope and sequence, or it may involve a restruc- 
turing of the hierarchies , of specified or implied objectives of one or two 
selected units. 

The reason sampling must be used with care is that one may not 
assume that if a portion of a given curriculum is well-designed the rest 
of it must be equally well-designed. Often different authors are responsible 
for different grade levels of a single curriculum. It would be possible to 
overlook this if the analyst were Rot forewarned. 

The procedures of the PIC model requll'e prestructuring concepts 
separately from content and skills before merging the three structures 



into one hierarchy. In conetructing this hierarchy, the logical order of . 
content and concepts, the sequence of elements of the subject rrtatter 
structure (concepts, principles, generalizations, and constructs), and 
the taxonomy levels of skills are considered. 

In this context, content is viewed as information, events, and 
data at the knoA^riedge level of the Taxonomy of Educational Objectives , 
Handbook It Cognitive Domain (Bloom, 1956). Concepts are those ideas 
associated with a particular discipline from which the structure of the . 
discipline is formed. The concepts of ayiscipline involve both knowledge 
and process and ma,y be identified by performing a concept analysis 
(Gow, 1977b). Skills include not only intellectual skills, which are called 
"behaviors'* in the Bloom Taxonomy, but also any manual skills and learn- 
ing management skills t\)At are part of the curriculum's instruction. 

The following steps are employed in restructuring the inferred in- 
structional hierarchy: 

I. The analyst performs a content analysis (logical 
sequence); concept analysis (subconcept, concept, 
principle, generalization, construct sequence); 
and skill analysis (taxoapmic level), 

Z. Tliese are combined to structure an instructional 
• hierarchy which displays how the curriculum 
attempts to attain its goals and the ..iterrelation- 
ships among the curriculum's goals and objectives. 

Some curricula may specify objectives and present already-struc- 
tured hierarchies (sometimes called scope and'sequence charts, which may 
or may not be expressed in student behavior terms# although they can be 
converted to such terms)* These hierarchies would be matched to instruc- 
tion, observing discrepancies and omissions of objectives or materials to 
teach specified objectives. For curricula which dp not have specified 



objectivei and/or hierarchies, the materials are examined and the ob- 
jcctives in^erred^nd structured, • 

' \l \ ■ 

, If extensive use is made of the hierarchy corva^fuction procedure 

\ 

: for Intrinsic. analysis, the hierarchies themselves provide a graphic 

f * 

presentation of what the curriculum attempts to do and ho\v it does it. 
They present the process of instruction. They should, therefore, bo 
presented to a selection committee as part of the rationale for any rating 
assigned to a curriculum pr.oduct. They may be meaningful only to H^e^ 
analyst, however,, if they are used only on. selected portions of thf cur- 
riculum^ They^pr^vide input for the struiture partion of the analysis in- 
strument. 

The analysis instrument ihqludes the following categories of 
questions unde4 the construct, structure: 

* * 

1. Are there specific expressed or clearly implied 
instructional objectives ? ' 

2. Is there a testing procedure to determine mastery 
of the objectives? 

3. Daes the instructor's manual provide guidance for 
diagnosis and remedial treatment? , . 

4. Are all objectives, stated or implied, measured .' ■ 
or checked by observation, a*hd are criteria provided? 

The questions under these categories relate to the match of objectives 
to the characteristics and needs of the students in the particular school for 
which the analysis is being performed, the degree to which t^e instruction 
matches the express-ed or implied objectives, the degree to which the, test- 
ing matches the objectives, the adequacy of guidance to the teacher for 
diagnosis, placement and progression and for remedial or supplementary 
instruction, and the degree the range of objectivec match the range of student 
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population. 'These are questions related specifically to the hi-erarchies 
constructed for analysis. T^ey require an indication of*how well the ob- 
jectives are structured and sequenced. to buiid towards the terminal goals. 
* For the construct, instructional events, the analysis instrument 

for instructional products requires responses to the following questions: 

!• Are the inst|;uctional strategies \ised appropriately 
according to instructional theory? 

2, To what extent do the materials provide explicitly 
for the use of higher level skill? (application, 
analysis; synthesis)? 

3, Are the instructional methods consistent? 

4, To what extent do the teacher manuals » in-service 

or parent, materials furnish the following; (a) informa-*^ 
tion in the subject area, (b) methodology, fc) vocabu- 
lary, (d) cstrategie.s ? ■ • 

Specific instructional strategies which have firm research sup- 
port are listed under question one to remind the analyst of some of the 
possibilities to watch for. Of course, when the particxllar site has speci- 
fic problems which seem to call for use'of a strategy not listed, or when 
the student population identified by the local action team (LAT) for atten- 
tion has speiial characteristics, such as perceptual problems, strategies 
appropriate for that specific population would be sought by the analysrin 
the instructional materials under consideration. 

The identification of instructional strategies can be simply an in- 
ventory to defin^ the instructional model more clearly. The process of 
identifying them also calls attention to neglect of strategies which might 
be particularly appropriate for certain kinds of instruction (e.g., model- 
ing of psycho-motor skills; advance organizers for learning from read- 
ing, etc. 
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Special attention should be given to concept-acquisifion strat'e- 
.gies. The kind and range_ of examples of each concept (content instances), 
their relevant and irrelevant attributes, should be noted. Failure to at- 
tain a concept may result from a defect in the instances ericounterec^ in 
instruction. Of course, when a hierarchy has been constructed for a 
portion of a curriculum, the range of content instances is quickly appar- • 
ent from observation of the hierarchy. ^ 
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The instrument for use when the school is searching for a manage- 
ment system, practice or process, rather than a curriculum product, is 
div4de^^to questions organized under the same constructs as for products, 
The major questions under each category are as follows; 

1. Structure: Are there specific process objectives 
(i.e., student self-management, learning-to- 
learn, maximal use. of expertise by team teaching, 
etc.)? 

2. Opportunity; Does this system or practice pro- 
vide more time for learning? 

3. Motivators: Does this system or practice offer 
advantages to both student and teacher which will 
encourage cooperation in implementing it? Does 
this system or practice provide the student with • 
more independence in managing his own learning? 

4. Instructional Events: Does this system or prac- 
tice permit the teacher more time to interact with 
students on a one-to-one basis? 

Management systems, practices and procedures must^b«^-trratched, 

not only to the characteristics of students, teachers, and administrators 
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but also to the instructional materials whether they are those currently 
in use or new ones being adopted". Therefore, analysis of a process 
seldom would be performed alone. It would b?, necessarily, as'part oi 
a more comprehensive program analysis* 

Analysis as^»n Aid to Adaptation/Implementation 

The hierarchy construction process reveals the undterlying design 
model of the analyzed .curriculum product or process. In the first section 
of this paper, k statement was quoted, objecting to the failure of simple 
analysis instruments to lead the critic into the structure of a program. 
The PIC design/analysis model, by strategic use of the hierarchy con- 
struction process, insinuates the analyrt into the structure at any point 
which appears to present a problem or at significant places in the program 
At the analyst's discretion, the entire curriculum structure can be recon- 
structed. 

The analysis instruments call for information on characteristics 
and quality of design elements including. methods, media and instructional 
--strategies. The management system is carefully anal; id and the teach- 
er props provided in the instructor's manual are identified and evaluated. 
Throughout the analysis, the analyst is collecting information 
^^ich f^^cilit^es his or her task of completing the instrument which ana- 
lyzes the instructional model. This instrument includes the following' 
questions: . 

1. What are the critical elements of this model? 

2. Are^jthese elements spec-ified by the developer? 

3. How do the materials support this cl^im? 

4. If not claimed, what evidence is there th^t/these 
elements are crucial? 

; 
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5, How do the teacher materials inform the 
teacher of the essentiality of these specific 

* model components? 

6. Is further in-service instruction necessary 
or advisable? 

7. What kinds of experiences are likely to impress 
upon the teacher the critical natu;-e of these - 
elements? 

8, How can the facilitator (PSIP) provide these ex- 
periences ? 

This component of the intrinsic analysis procedure is expected to 
aid the adaptation process. It i^a well known, generalization about school 
change that adoptions seldom are adopted' without adaptation to local needs. 
Indeed, even within a school, individual teachers tend to make changes 
according to the teaching style to which they are accustomed. Some- 
times these changes are appropriate and necessary. Often, they under- 
mine the principles which are critical to the effective implementation of 
the curriculum model (Gross, et al, , 1971; Havelock, et al. , 1969; Pincus, 
1974; Goodlad. 1969). 

By intensive intrinsic analysis, and particularly by using the hier- 
archy construction process, the analyst "gets inside" the curriculum to a 
degree that is not^ossible through, any simple inventory or purely descrip- 
tive process. By using the criteria of the site for which the analysis is 
performed with the researc'h supported principles of instruction as the 
only other criteria, each element of the product or process is weighed 
separately and in its relation to every other element, bringing the critical 
elements of the model into sharp focus. 

Whether the analysis is performed by the local action team (LAT) 
or is presented to them by thjp; research team (RT), these critical elements 



should be highlighted and* plana should be made for impressing them 
upon all teachers "iind administrators who will be involved in implementa 

t 

tioHs. The school assistance team (SAT) should plan training, for imple- 
mentation in such a way that a range of possible adaptations and of 
adaptations which would undermine the system (negative instances) are 
presented so the implementors will conceptualize the model. If adapta- 
tion is inevitable, it would appear to be wise to use every possible teach 
ing strategy to assist the implementors in making their adaptatioits con- 
structive ones. ^ . ' 
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IV. USES OF INTRINSIC ANALYSIS 



Necessary Knowledge ^nd Skills 

For the persons who would supervise or carry out intrinsic 
' analysis procedures as members of a research team (RT) or a school 
assistance team (SAT), a background in curriculum design and curricu- 
lum analysis would be helpful. More spfecificallyi learning theory, in- 
structional theory and applied instructional design principles are neces- 
sary knowledge and skillss It is^ important that the researcher have 
available up-to-date information on the research in the specific area of 
concern to the schools with which he or dhe is working. 

In the PSIP plan of action, the knowledge consolidation function 

and the analysis function are carried out by the jsame team* The knowU 

/ 

edge consolidation task includes synthesizing relevant research as it is 
needed, so current research information is readily available as input into 
the analysis process. 

When analyses are carried out, under supervision, by local selec- 
tion committees trained for the task, some of the behaviors which should 
be taught and practiced with sample materials, if they are not presently 
in the repertoire of the team members, are the following: 

1. coding objectives to taxonomies 

2, performing ta«k analyses (minimally) 

3^ performing content, concept, component 

analyses (preferably) 
4* matching objectives to tests • 
5, matching insti'uction to objectives and tests 
6* identifying instructional strategies in student *^ 

materials 

7, analyzing the syntax of the student reading 
materials 
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Use of the Procedures by R&D Agcnciea 

The full set of curriculum analysis procedures described in this 
paper arc best used by R&D agencies which may be presumed to have 
staff with the necessary competencies to reconstruct the expressed or 
implied objectives of a curriculum into hierarchies and to chart them 
for cognitive and affective domains (if relevant) for each curriculum 
goal. (See appendix for elements of a typical charted hierarchy.) In- 
deed, this hierarchy construction process could be used to describe 
R&D outcomes and to present graphic representations of each such out- 
dome permitting ready comparison among potential selections in a form 

« 

which demonstrates the process of instruction as no inventory or descrip- 
tive analysis could do. Gaps an<^ deficiencies become readily apparent 
and the adequacy or inadequacy of concept instances can be quickly spotted. 

However, the time required to perform such a complete intrinsic 
analysis is prohibitive unless it is undertaken on a major scale as a dis- 
semination strategy. Even the use of the model through sampling pro- 
cedures as is being done by the research team of the R&D Utilization 
Project of PSIP is a very demanding process. 

When a hierarchy has not been charted for each goal for presenta- 
tion to the selection committee, and sometimes in addition to whatever 
charted hierarchies have been completed, a matrix is filled out by the 
analyst for selection purposes. This matrix lists as many outcomes as 
^ remain as potential adoption candidates after the, local action team has 
. nar.rowed the field as much as possible^ screening it through their con- 
straints and criteria and examining the actual materials^ Each outcome 
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is rated on the quality of atructure (testing and sequencing); motivators 
(match of interest to this population and reward system); opportunity 
(intensity of instruction);, instructional events (quality of teacher props); 
instructioiul strategies (appropriateness for this population, adequacy 
of strategy usage); and content (esse||itial knowledge, essentia-l concepts, 
essential skills). The matrix is accompanied by a support document 
which identifies the research support (from the literature search) and in- 
structional theory basis for the rating. 

This decision-oriented document facilitates decision-making. It 
does not prescribe. It will be necessary for the selection committee 
(LAT in the PSIP) to use the information presented, weigh the advantages 
and disadvantages of each outcome on the basis of the committee's own 
weighing of each element. For example. Outcome A may be rated higher 
on instructional events than Outcome B but lower on structure and motiva- 
tors. Each outcome probably would vary along different dimensions, ^^e 
rationale document could be consulted for details. The matrix would sin- ply 
ease selection, not direct it. 

In spite of the complexity and time-consuming characteristic of 
the intrinsic analysis process, there are so many advantages to it com- 
pared with the usual analysis process, it seems worthwhile to suggest some 
possibilities for its use with and by teachers on local action teams, as an 
alternative to its use by R&D agencies. 

Use of Simplified Procedures With Teachers 

The PIC Model for curriculum design/analysis has been taught to 
several hundred graduate students at the University of Pittsburgh, most 
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of whom are teachers. Both as a design model for constructing courses 

I* 

and an analysis model for use by curriculum consultants working with 
university professors, it has been used to develop extra-mural courses 
and to analyze and formatively evaluate them in the University External 
Studies. Program (UESP).of the University of Pittsburgh (University Externa 
Studies Program, 1977). There is no doubt, therefore, of the practicality 
of the model and. its usefulness for teachers. 

While the hierarchy construct4pn process is the unique feature of 
the analysis model and an essential feature to reveal the flow, or process, 
of instruction, often lack of time prohibits full use of this procedure. In 
such cases, abbreviated procedures are used to sketch out rather than 
map out the structure and sequence. These abbreviated procedures involve 
the use of a kind of |^horthand. For example, instead of a behavioral ob- 
jective, a simple verb may be used or a taxonomy level. Sometimes, the 
three essential analyses (content, concept, skill, or component analysis) 
are not combined as they must be for design purposes. Each is evaluated 
separately. This does not provide the graphic roadmap that is suc^ a 
satisfying and helpful feature of the model if it is used for presentation to 
the client for whom the analysis is performed. If the analysts are perform- 
ing the analysis for their own use it is not necessary to combine the three 
separate analyses. A manual for instructional materials analysis, which 
will be a recipe book for use of the model in both the comprehensive and 
simplified versions is being constructed. It is expected that the manual 
can be used in one or two week workshops with local selection teatns (LATs), 
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Among the competencies which would be taught to teachers 
arc those identified in the first* section of this chapter. Exercises woyld 
be required providing practice in matching objectives to teste, lessons " 
to tests and objectives, identifying instructional strategies and construct- 
ipg hierarchies. 

When teacher teams perform analyses for their own use, it is pos- 
sible for them to tak^many shortcuts. Since they have established the 
criteria and constraints and they will weigh the different dimensions as to 

their relative importa^e.when they select among R&D outcomes which are 

. r ■ 

rated separately for each design element, they also may decide in advance 
certain elements are of such overriding importance to them they will be 
analyzed and others excluded. In other words, once they have learned 
the analysis model, they may use it selectively for their own purposes. 
The model adapts readily to the needs of the local school. 
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V. THE INTRINSIC ANALYSIS PROCESS AND RESEARCH 

Effects on Adaptation/ Implementation 

This paper ha« described an intrinsic analysis process which in- 
volves the use of a hierarchy construction tool as one technique in the 
analysis of instructional products and processes. The PIC model for 
curriculum design/analysis includes, also, the examination of instruc- 
tion, as found in student materials and other instructional artifacts for 
research-based instructional strategies, their correct usage, and their 
evaluation on the basis of appropriateness for the student population for 
whom they are intended, 

CXit of this kind of intrinsic analysis the instructional model is 
deduced and the critical elements of that model are described in an attempt 
to facilitate adaptation of the product or process to the requirements of the 
adopting school with as little risk as possible of adaptation which might 
undermine effectiveness of the product or process. Of course, it was with 
the expectation that this emphasis on the critical elements of the model 
would discourage inappropriate adaptations that an analysis model high- 
lighting these critical elements was selected for theliSIP procedures. 
However, whether or not it serves this function may depend, in part, on 
how effectively we are able to convey information to the teachers about 
the critical elements of the model and how successful is the in-service 
training for implementation. 

It is suggested that a question researchers should address is the 
effect on implementation of identifying critical elements of the model and 
conveying this information to the school staff. 
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Another important question to be addressed is the effect of tailor- 
ing both information (knowledge consolidation outcomes) and analysis pro- 
cedures to the needs of the individual school. In the PSIP process, there 
are. always some criteria of the local school, which require analysis of- 
special features of a product or process (e.g., individual learning style, 
grouping). Because the PSIP is concentrating on basic skills, the litera- 
ture search resulted in a Synthesis of Research in Basic Skills . (Cow. 1977c) 
which identified effectiv'fe strategies in reading and math. Analysis for a 
school which identifies some aspect of reading, such as decoding, as a 
problem, would be tailored to search R&D outcomes for those which 

o 

ploy strategies endorsed by research as well as con«^sus recommendations 
of Jthe reading specialists in decoding. 

The evaluation data of PSIP are expected to contribute useful in- 
formation to help answer these researchable questions. 

Effects on Teaching Skills 

The impact of a program such as the R&D Utilization Project cannot 
be measured solely by the attainment of its immediate goals nor even its 
long range goals. Among the latter, the establishment of linkages between 
R&D^agencies, the state educatioa department, and its intermediate units 
and local sohools has resulted in many spin-off interrelationships which 
have encouraged graduate work for teachers, fostered training workshops, 
etc. One of the most important of these spin-offs can only be guessed at, 
but its parallel with some similar work at the university level suggests it 
should not be overlooked. That is, the effect, if any, of the process on 
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teaching skills of selection committee members (LAT), It should be 
observed by those doing cake studies on the project and would be an in- 
teresting subject for future research. In a situation where university 
professors are helped by curriculum specialists to analyze and rewrite 
their present curricula in order to make them seU- instructional for use as 
extra-mural courses, the professors become aware of instructional design 
principles in the process. Many of these* professors have never taken a 
course in the discipline of education and, 'indeed, are skeptical that it has 
anything to offer.. Several of these professors have observed changes in 
their own teaching behavior and have commented on it to the curriculum 
specialists, who were trained in the use of the PIC design/analysis model, 
which is also used for the development of these extra-mural courses (Gow 
& Yeager, 1975; University External Studies Program, 1977), 

The University (of Pittsburgh) External Studies case has many 
parallels with the change mbdel in use in the PSIP Program. Most of 
the selection committee team members (local action team), of the 
schools with which we are working, are unfamiliar with the R&D Utiliza- 
tion procedures, do not at first recognize the value of them, and when 
they begin to understand the process, they appear to" recognize its useful- 
ness and value it. The intrinsic analysis part of this process, whether 
at the program analysis stage or the outcomes analysis part of the 

selection process, is done by the PSIP research team and presented to 
the local action team. This is because of time constraints. The LAT 
could, itself perform the analysis after the kind of training described 
above. 

40 
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It would be most interesting to know if the process of carrying 
out such an analysis would affect the teaching behavior of the team 
members. There are indications that even when the'analysis is pre- 
sented to the local action team by the research team, with the necessary 
rationale and explanation, the teachers begin to develop a new pe^spoctivi- 
on curriculum. They ask questions about how to match tests to objectives 
and about unfamiliar instructional strategies, take notes on them, and 
appear to be deeply interested. • • -v 

Use of the Cooley-Lohnes constructs, repeated exposure to them 
in collecting needs analysis information, in program analysis and in out- 
comes analysis certainly should create, at the least, an awareness of 
their importance. The teachers, during these procedures, should acquire 
a significant body of information on each of these constructs in relation to 
their students, their program , and the potential programs they are con^ 
sid.ering for adoption. They should learn in the process of analysis, not 
only that strategies used should be appropriate for the specific students, 
but how they should be used; not only that test items should match objec- 
tives but that for matching test questions the items should be parallel in 
construction and for multiple choice items, distracters should be plaus- 
ible. They should learn that not only should, objectives (and instruction) 
be correctly structured and sequenced to permit each student to succeed 
and there should be branching sequences if the program is to provide for 
individual differences, but how structuring is designed a;«i how it is analyzed. 

Effects on Students 

The ultimate aim of the Pennsylvania School Improvement Program, 
of course, is to provide more effective instruction for students. It would 
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seem logical that if the selection process, a portion o.f which is described 

• ■ * 

in this paper, permits schools to put together programs tailored to their 
individual requirements, students must, indeed, benefit from the better 
fit. Whether or' not this is the case, of course, is, again, a researchable 
question. ^ ' " 

The general categories of questions raised in this section relating 

to program effects on adaptation, teachers and students will be asked bf and 

V 

by all of the R&D Utilization Projects of which the PSIP is one example. 

The differences in the questions which" we think must be answered, are re- 

lated to the specific features of this intrinsic analy&is model. We would 

like to know the effects, if any, of the following features of the model on 

students and teachers and on the kinds of adaptations that are ma."de and 

their effectiveness: 

!• The identification of critical elements of the product 
or process model and the emphasis on making the 
teachers aware that these elements are critical 
to" effectiveness. 

2, The tailoring of information and analysis procedures 
to the needs of the site. 

3, The emphasis on researgh^based instructional design 
principles and research-supported instructional strate- 
gies..- 

4, The hierarchy-construction feature which permits 
the assembling of a unique collection 4of instructional 
materials^ basic and supplementary; and of manage- 
ment systems suited to the site while retaining the 
kind of highly structured program the research sup- 
ports. 



42 



VI. CONCLUSION 

« * 

This paper has presented a rationale for the use of intrinsic 
analysis procedures, and specifically the PIC Model for design/analysis, 
to uncover the structure and process of instructional materials. This 
process does not duplicate infornnation already existing in another'form 
(i.e. , NIE Product Catalogue jJjJPIE Analyses, CMAS Analyses, etc. ). 

j 

It does not describe outcomes or cost information. It makes explicit 

quality characteristics which can be compared. The model is flexible. 

Dimensions analyzed can be added or subtracted according to the t>ur- t 

pose of the analysis. 

An intrinsic analysis, as distinct from an evaluation whict^uses' * 

outcome measures and classroom processes, employs research criteria - 
^to make deqisions about the adequacy of tangiblex curricular components 

in order to select, reject, supplement, complen ent, or change a giv^n 

instructional product or process. 

The identification of'the critical elements of a program or practice 

becomes quite a simple process when the full set of hierarchy construction 
procedures of the PIC ModeKiire used. This has been done for an entire 
elementary school science program. Individualized Science (IS) (Cow, 

1977a). Identification of the model when a simplified intrinsic analysis 
is performed becomes more of an art than a science. Analysis of a range 
of R&D programs and practices for the R&D Utilization Project is expected 
to contribute to the refinement of this element of the model, hopefully help- 
ing to establish the limitations on simplification qf procedures which still 
will permit enough manipulation of the artifacts to reveal the critical ele- 
ments of the product or process. 



The information derived from the analysis is organized under 
four constructs of the Cooley-Lohnes Model (1976) which represent di- 
mensions of instruction which research has shown are important for 
learning. The Cooley-Lohnes construct, instructional events, refers 
in evaluation to intcracti4?ns which are beyond the scope of an intrinsic 
analysis. However, if the instructional model requires that the teacher 
teach in a prescribed way, the quality of the props provided to facilitate 
these behaviors is important. This is examined in the analysis. It may 
be in the form of information, instructions or rationales foj student ex- 
ercises and prescribed teacher respohses. In addition, the instructional 
strategies actually used in the^aterials, their appropriateness for the 
students for whom they are used,t and the correctness of their uselis pre 
scribed by research evidence of effectiveness are analyzed. This proc- 
ess adds a new dimension and purpose to the Cooley-Lohnes constructs. 

The yerarchy construction tool, also augments the Cooley-Lohnei 
construct, structure, since it suggests analysis procedures for supplying 
tangible evidence of degree and appropriateness of the structure of the 
materials being analyzed. Structure analysis involves examining the 
appropriateness of the sequence of instruction and the way students pro- 
ceed through it. Therefore, an analysis of structure includes looking at 
the performance demands on the student to be sure they are taught how to 
behave in a certain way before they are required to do so. 

Use of intrinsic analysis by R&D agencies and by teachers has 
.been described and the required knowledge and skills for performing such 
an analysis have been specified. 



Finally, fome of the reiearchable quettions growing out of the 
intrinsic analysis process have been suggested. 

In PSIP, we expect that^tfie entire selection process, involving, 
as it does the tailoring of procedures to the local situation, within the 
confines of the general model, will result in successful implementation 
of change. Evaluation of the project, including the ca^e studies, should 
provrpe'some indication of the accuracy of our expectations, and we can 
say with some confidence, before that evidence is collected, that the se- 
lection pvo'cess we have designed isjnore rational than the traditional 
selection process described at the beginning of this pap'er. 

( 



45 



References 



Amidon, E. J, , k Giammatteo, M. M. The verbal behavior of super- 
ior elementary teachers. In. E. J. Amidon & J. B. Hough (Eds. 
Interaction analysis; Theory, research and application. ' Read- 
ing, Mass.: Addis on- Wesley Publishing Co. , 1967. 

Berliner, D. C. , St Gage, M. L. The psychology of teaching methods. 
In N. L. Gage (Ed. ), The psychology of teaching methods , ?5th 
yearbook of the National Society for the Study of Education, Part 
1. Chi^cagof University of Chicago Press, 1976. 

Blbom, B. S. (Ed. ) Taxonomy of educational objectives. Handbook 
I; Cognitive domain . New York: Longmans, Green, and 
Co., 1956. 

Brophy, J. E. , . & Evertson, C, M. Process-product moment correla - 
tions in the Texas teacher effectiveness study: Final report . 
Austin, Texas: JJniversity of Texas, 1974. 

Catalogue of NIE Education Products (vols. 1 ii 2), Washington, D. C. : 
U.S. Department of Health, Education, and Welfare, National 
Institute of Education, 1975. 

CMAS Curriculum Materials Analysis System . (Short form, revised). 

Boulder, Colorado: Social Science Education Consortium, Inc., 
May, 1971. 

Compensatory Programs Report, Common Characteristics of Success - 
ful Compensatory Education Programs. Washington, D. C. : 
Department of Health, Education, and Welfare, USOE, 1974. 

Cooley, W. W. , & Leinhardt, G. The application of a model for in- 
vestigating classroom processes (LRDC Publication 1975/24). 
Pittsburgh: University of Pittsburgh, Learning Research and 
Development Center, 1975 

Cooley, W. W. , Lohnes, P. R, Evaluation research in education. 
New York: Irvington Publishers, 1976. ^ '. 

> 

Eash, M. J. An instrument for the as"sessment of instructional materials 
(Form IV). In H. J. Walberg (Ed. ), Evaluating educational per- 
formance > Berkeley, Calif. : McCutchon Publishing Corp. , 1974. 

EPIE (Educational. Produ<^ts Information Exchange). Improving materials 
selection procedures: A basic "how to'! handbook. New York: 
EPIE Institute, 1973. ~ 

Educational Programs that >Vork. San Francisco: Far West Laboratory 
for Educational Research and Development, 1976. 



46 



Goodlad, J. I. Thought, invention and reiearch in the advancement 
oT education. The tchoole and the challenge of innovations. 
New York: McCraw Hill 6o6k Co. , iM^, 

Coodm;an, K. S. , b Goodn:i*n, Y. M. Learning to read la natural 
In L. .Resnick & P. Weaver (Eds.), Theory,?nd practice of 
early reading. Hillsdale, N. J. : Lawrence Erlbaum Associ- 
ates, m press. 

Cow, D. T. Analysis framework for organization of information 

(baseline data) . Unpublished manuscript, University of Pitts - 
burghs Learning Research and Development Center, 19'?6. 

Cow, D. T. A curricu lum analysis of Individualized Science. Pitts- 
burgh: University of Pittsburgh, Learning kesearch and De- 
velopment Center, 1977(a). . . 

Gou', D. T. Design and development of curricula materials . Pitts - 
burgh Center for International Studies Publications, 1977(b). 

Gow, D. T. A synthes is of research in basic skills. . Unpublished 

manuscript. University of Pittsburgh, Learning Research and 
Development Center, 1977(c). 

Gow, D. T. , & Yeager, J. L. I^he design and development of individ. 
ualized curriculum materials for higher education. Journal 
of Higher Education . 1975, 46(1), 41-54. 



Gross, N., Giaquinta, j., & Bernstein, M. Implementing organiza - 
tional innovat ions: A sociological analysis of plannea educ ational 
chang e. New York: Basic Books, Inc. , 1971. ' 

Havelock, K. G. , Guskin, A. , Frohman, M. , Havelock," M. , Hill, M. , ' 
k Huber, 1. Planning for innovation through dissemination and 
utilization o f knowledge . Ann Arbor. Mich. ; Tnsfifnf^ fr^r- g^^^^i 
Research, Center for Research and Utilization of Scientific Knowl- 
edge, University of Michigan, 1969. 

Klausmeier, J. J., & Hooper, F, *^J. Conceptual development and instruc 
tion. In F. N. Kerlinger (Ed. ), Review of research in e ducation 
(vol. 2). Itasca, 111. : F. E. Peacock, 1974. 

Kunder, L. H.- Procedures for textbook and instructional materials 
selection; An ERS report . Arlington, Va. : Educational Re- 
search Service, Inc., 1976. 

0 

Lewin, H. , Lippett, R. , & White, R. Patterns of aggressive behavior 
in experimentally created social climates. In E. J, Amid on. & 
J. B. Hough (Eds.), Interaction analysis ; Theory, research and 
application. Reading, Mass. : Addison- Wesley Publishinc Co. 
1967. - b • . 

47 



Morrittett, I., Stevena, W, Wl , Jr., it Wpodley, C. P. A model for 
analyzing curriculum materials and classroom transactions. 
In D. M. Fraser (Ed. ), Social studies curriculum development; 
Prospects and Problems . 39th Yearbook. Waahington. D C!. . 
National Council for the Social Studies, 1969. 

Pincus, J. Incentives for innovation in the public schools. Review of 
Educational Research. 1974, 44(1), 113-144. 

Rosenshine,. B. Classroom instruction.^ In N. L. Gage (Ed. ), Jhe 
psychology of teaching methods . ' Chicago: National Society 
for the Study of Education, 1976. 

Rosenshine, B. Teaching behaviors and student achievement. Slough,' 

England: National Foundation for Educational Research in England 
and Wales, 1971. » 

Soar, R. B. Follow* Through classooom process measurement and pupil 
growth (1'970-71); Final report. Gainesville: University of 
Florida, College of Education, 1973. 

Stallings, J., I» Kaskowitz, D, H. Follow-. Through classroom observa - 
tion evaluation. 1972-73 . Menlo Pa rk^ Calif. : Stanford Research 
Institute, 1975. / 

a 

Tyler, L. L.^, & Klein, M. F. Recommendations for curriculum apd 

instructional materials . Los Angeles, Calif.: Tyl Press, 1971. 

UESP (University External Studies Program). Five year report . Pitts- 
burgh: University of Pittsburgh, 1977. ' 

Walker, D. F. , & Schaffarzick, J. Comparing curricula. Review of 
Educational Research . 1974, 44, 83-111. " 

Westbury, I. Curriculum evaluation. Review of Ed ucational Research, 
1970, 40(2), 239-260. ': — 

Wiley, D. W. & Harnischfeger, H. Explosion of a myth: Quantity of 
schooling and exposure to instruction, major educational vt- 
hicles. Educational Researcher . 1974, 3(4), 7-12. 



APPENDIX 



ERIC 



49 



ERIC 



Analysis Instrvypients 
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— ■ f 

Student Materials^ Inservice MateriaU, Parent Materials 
Structure: ' 

!• Are there specific expressed instructional objectives 
or clearly implied objectives? 

A. To what degree do they match the identified 
characteristics and needs of the students in 
the target school (teachers, parents)? 

B. To what degree does the instruction teach to 
the objectives? 

H, Is there a testing procedure to determine mastery of 

the objectives? 

» 

A. How .well do the test items, observation guide- 
lines or. other mastery criberia match the im- 
plied or explicit objectives?^ 

B. How well are the objectives structured and se- 
quenced to. build toward/ the terminal goals? 

1* as indicated by a concept analysis? 
(sampling) . 

2» as indicated by a content analysis? 
(sampling) 

3. as indicated by a component analysis? 
(sampling) 

IIL Does the instructor's manual provide guidance for 
diagnosis and remedial treatment? 

A. How adequate are the props which the instructor's 
manual provides to guide the teacher (I. U» or 
other agency instructor) in diagnosis of student 
needs and for placement and progression? 

B« How adequate is the guidance supplied by the 
teacher*s manual for alternate^ remedial or 
supplemental instruction for students? 

C. To what degree do the range of the objectives 
alone or the objectives combined with the remedial 
or supplemental instruction match the range of the 
student population? 
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IV. Are all objectives, itated or implied, measured or 
checT<eB by observation and are Criteria provided? 

A, Affective •* 

« 

Be Cognitive 
C. Psychomotor 

Opportunity: 

!• Do the materials t^ach in a; clear, focused and con- 
centrated way? ' * 

< 

A. To what extent do the materials supply concentrated 
cognitive activity for the student (parent, teacher) 
to assi^re adequate opportunity to learn? 

B. To what extent do the materials provide the oppor- 
tunity to learn for bc^th slow and fast students 
(i.e., clarity, explicitness in directions, small 
steps, transition sentences, etc.)? 

II. Are the activities appropriate for the student population 
so there is opportunity to learn? 



A. Are the activities appfiropriate for the developmental 
level and socio-economic characteristics of the stu- 
dent (i. e., concrete, manipulative for younger chil- 
dren; greater in-school exposure to oral language 
for low socio-economic level children, etc.)? 

B. Are the. examples provided relevant to the student 
experience, needs, stage of instruction, to provide 
opportunity for the student to conceptualize? ^ 

Motivators: 

I. Is there an opportunity provided for the student (parent, 
teacher) to plan his/her own instruction? 

A. To what extent does the student (parent, teacher) 
select instructional activities? 

B. To what extent does the student plan his/her pro- 
gram? 
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U. Are materials functional (i. e. , related to life exper- 
iences)? ' * » 

A. • To what extent ^ocs math pose problems the 

student might be expected to. encounter? ' 

B. To what extent are problems interesting and 
. puzzle-like? 

♦ 

C. To what extent are students taught the practical 
functions of reading? 

III. Do the materials provide reinforcement or do they 
instruct the teacher how and when to do so? . 

A. To what extent do they provide reinforcement 

by management and use of the Premack principle ? 

B, To what extent do they provide reinforcement 

by appropriate feedback, use of praise, students' 
ideas, etc.? 

IV, Do the materials permit individualization of instruc- 
tion? 

A. Are there a variety of modes of instruction? 

B, Are there alternative (branching) paths through 
the materials to accommodate individual dif- 
ferences ? 



Instructional Ev&nts: 

I, Are the instructional strategies used appropriately 
according to instructional theory? 

A, To what extent do the ma.terials, provide the 
following in appropriate places and used ef- 
fectively? 



The Premack principle states that any high probability behavior 
can be used to reinforce any lower probability behavior. For example, 
a game the children enjoy playing can be promised "after you do these 
three math problems" or the student who does not like to read aloud but 
enjoys reading to himself can be told "read this sentence aloud, then you 
can read the rest of the story to yourself, " 
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1. •mall steps 

2. cues and prompts 

3. questions in the textual materials 

4. advance organisers 

5. backward chaining 

6. irrumediate feedback 

7. reinforcement 

S. appropriate range of content instances 

9t specific strategics supported by the re- 
search in the target subject area 

To what extent do the materials provide explicitly for 
use of higher level skills (application, analysis, syn- 
thesis)? 

Are the instructional methods consistent? 

A* To what extent do the methods used conform 
to the claims of the developers (it e, , if in- 
quiry is claimed, does the student consistently 
^inquire independently)? 

To what extent are the instructional methods used 
appropriately (i. e, , are the problems plausible 
and relevant to the students in a problem approach; 
does a phonic approach consistently demand the 
same word attack skills it teaches, etc. )? 

To what extent do teacher manuals, ^in-service or pairitnt 
materials furnish the following? 

A. Information in the subject area that teacher 
"^parents) may not know. 

Methodology--how to do it. 

C. Vocabulary--definitions of terms. 

D. ' S^rategie«--what to do that can be expected 

to be effective. 
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Management- Systems^ Practices or Processes 
Structure: 

I. Are there specific process objectives (i.e., stu- 

dent self-management, learning-to-lea rn, maximal 
use of expertise by team teaching, etc. )? 

A, To what degree do the objectives match 

the identified problems in the target school? 

B, To what degree are adequate instruction and/or 
explicit directions provided for the- user of the 
system, process? 

C, To what degree do the demands of the objectives 
' match the capabilities of the students and teach- 
ers and the constraints of their environment? 

4 

Opportunity: y 

I. Does this system or practice provide more time 
for lea rning ? ' 

A. To what extent does the system or practice 
give the student more on taa-k time? 

B. To what extent does the practice or system 
give the teacher more time to actively teach 
or guide student learning?. 

Motivators: 

I. Does this system or practice offer advantages to both 
student and teacher which will encourage cooperation 
in implementing it? 

f 

A. To what extent does it save the teacher tin:ie 
and/or effort? 

B. - To what extent does it help the teacher teach 

more effectively? 

C. To what extent does it help the student spend 
more active time in learning what he/she finds 
interesting ? 
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Does this system or practice provide the student 
with more independence in managing his- own 
learning? 

A, To what extent do^^i tlve student have a chance 
to select his own topie, reading, activity, etc. ? 

B, To what extent does he have a chance to cor- 
rect his own work, decide when he is ready to 
go on to a new activity? 

C. To what extent is he/she permitted, encouraged, 
to plan his/her own time? " ' 

D. Is the student allowed to work with his/her own 
friends^ tutor or be tutored or otherwise inter- 
act, cognitively, with peers? 




InstructipnaJ Events: 

I. Does this system or practice permit tjie teacher 
more time to interact with students on a one-to- 
one basis ? 

A, To what extent does the system relieve the 
teacher of management, clerical duties ? 

To what extent does the system permit stu- 
dents to manage their own activities so -the 
teacher can serVe as monitor and guide for 
learning ? 

C. To what extent does the system permit and 

encourage creative teacViiiig by suggestion, ex- 
ample, instruction, etc. ? 



Analysis of the Curriculum Model or the Instructional 
Management Process 

I. What are the critical elements of this model? 
.II. Are these elements specified by the developer 

III, How do the me^teri41s F^pport this claim? 

IV. If not claimed, what evidence is ther^ that 
these elements are critical? 

V, How do the teacher materials inform the teach 
er of the essentiality of these specific model 
components? 

VI, Is further in-service instruction necessary or 
advisable? 

VIL What kind of experiences are likely to impress 
upon the teacher the critical nature of these 
elements ? 

VllU How can the facilitator (PSIP) provide these 
experiences ? 
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THE PIC DESIGN/ ANA LYSIS MODEL 
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The PIC Model 

' ' 'I 

m 

The hierarchy construction process employs the PrQCess Individ- 
ualized Curriculum model or the PIC model (see Cow, 1977c), The pro- 
cedures of the PIC model require prestructuring concepts separately 
from content and skills before merging the three structures into one 
hierarchy. In constructing this hierarchy, the logical order of content 
and concepts, the sequence of elements of the subject matter structure 
(concepts, principles, generalizations, and c ofistructs), and the taxonomy 
levels of skills are considered. ^ 

The content structure of most curricula is the easiest element to 
identify. However, for a curriculum that explicitly emphasizes concepts, 
the concept structure is more readily identified. The specific content in* 
stances may not be crucial for a concept-structured curriculum. What is 
important is the range of these instances and the number of relevant and 
irrelevant attributes. (Klausmeier & Hpoper, 1974). For any curriculum, 
the concept structure should be identified and the content instances should 
be charted to display their function in concept acquisition. The evaluator 
v/ho uses the hierarchy construction process can be confident that the hier- 
archies produced reflect the structure of the actual curriculum, whether 
or not it matches the designer's intent. The curriculum materials reflect 
the decision made by the designer in selecting from among alternative struc- 
tures, and they are the evidence that limits the range of possible interpreta- 
tions when an existing curriculum is analyzed* 



The use of the PIC model to consti^uct hierarchies for curriculum 
analysis and evaluation is especially appropriate for individualized curricula. 
However, any formal instruction may be expected to have objectives bui^t on 
one another as instruction proceeds. Both the objectives and the structure 
may be implicit rather than explicit, but they exist and can be charted. 
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Using the PIC model for analysis of a curriculum involves the 
iollowing steps: 

V 

!• Carry out content, concept, and, skill analyses 
and combine to structure an instructional hier* 
archy, 

A, Some curricula may specify objectives and 
present already-structured hierarchies. 
These would be matched to materials, ob- 
serving discrepancies and omissions of obj- 
jectives or of matei^ials to teach specified 
objectives, (The latter, then, would be noted 
for Step IV. ) 

For the curricula which do not have specified 
objectives ar^/or hierarchies, the materials 
are examined and the objectives* inferred and 
structured. 

To construct the hierarchy, concepts are ana- 
lyzed by dete,rmining, across all levels (grades, 
or units in a single curriculum), the hierarchical 
sequence of concepts, principles,- generalizations, 
and constructs. The content instances are then 
analyzed and placed under the appropriate level 
of the concepts of which they are examples. Finally, 
the skills are merged with concept and content in- 
stances to define, in beh^ioral terms, the implied 
objectives. 

II. Identify instructional strategies. 

A. The identification of instructional strategies can 
be simply an inventory to define the instructional 
model more clearly. The process of identifying 
th em also calls attention to neglect of strategies 
which might be particularly appropriate for cer- 
tain kinds of instruction (e.g., modeling for psy- 
chomotor skills! advance organizers for learning 

, from reading; etc* )• 

B, Special attention should be given to concept-acquisi- 
tion strategies. The kind and range of examples of 
each conceot (content instances), their relevant and 
irrelevant/attributes, should be noted. Failure to 
attain a concept may result from a defect in the in- 
stances encountered in instruction. The range of 
content instances, of course, is quickly apparent 
I'ron^ observation of the hierarchy. 



B. 
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III. 



Describe the instructional model. 



IV. 



A. Identify specified or' inferred goals and objec- 
tives andvtheir interrelationships (from I 
above). v 

B. Specify principles of instruction used in the 
curriculum materials, management systom 
and teacher directions {from II above), • 

For further evaluative research, identify components 
of the curriculum which seem to suggest fertile fields 
for investigation. 



Hierarchy Construction 

In constructing the hierarchies, separate charts are built for 
the cognitive and affective domains and for other elemet^t| of the curricu- 
lum which represent separate expressed or implied goal/. The levels at 
which objectives are charted depends upon the instructional sequence (if 
one is prescribed), the taxonomy level, the level of abstractness, and 
the concept leveli 

The elements of a typical hierarchylare identified in the follow- 

7 

ing labeled example, ^ 



14 
12 



13 
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Terminal goal. 

Subgoal of terminal goal. 

Terminal objective of an instructional 
sequence. 

Subterminal objectives. Distinctive ele- 
nients of terminal behavior. 

Instructional objectives. 

Distinctive elements which are com- 
ponents of 6. 

Distinctive elements of 5. 

The lines that connect objectives vertically represent dependency 
relationships. Horizontal lines connect separate elements that lead and 
contribute to a common objective, but that are not dependent on each 
other. The branches of a hierarchy generally represent different phenom- 
^a towards which the student's behavior is directed. They also may repre- 
sent separate content of particular elements of a goal that make distinctive 
deipands upon the student. The process of analysis calls upon the analyst/s 
Skills in identifying and categorizing distinctive features of such demands. 

In preparing hierarchies for curricula with specified goals and 
objectives, a footnote is added when the wording of expressed objectives 
is changed by the analyst or when two or more objectives are cpmbined. 
Footnotes also are added if rewording changes the meaning or emphasis 
of an objective, or il an objective is added to represent a learning exper- 
ience for which there is no expressed objective, or if an objective is added 
to represent an untaught objective prerequisite to a specified objective. 

^2 



J 

14 

11. 12, 13 

10 

6, 9 

1, 2, 3, 4, 5, 7, 8 

2, 5 

3, 4 



For curricula that do not have expressed objectives, it is simpler to 
footnote those goajs and objectives stated by the develbper, instead of 
those implied or added* In either case» it is important that a clear dif- 
ferentiation be made between the developer's words and expressed intent 
and the analyst's words and inferences. 
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